AD-A073  178  FEDERAL  AVIATION  ADMINISTRATION  WASHINGTON  DC  SYSTEM— ETC  F/G  1/3 

OPERATIONAL  EVALUATION  OF  AN  OPTICAL  INFRARED  AIRBORNE  PROXIMIT— ETC (U) 
DEC  78  E LUCIER 

FAA-RD— 78-153 


UNCLASSIFIED 


NL 


Document  is  available  to  the  U.S.  public  through 
the  National  Technical  Information  Service, 
Springfield,  Virginia  22161. 


U.S.  DEPARTMENT  OF  TRANSPORTATION 

FEDERAL  AVIATION  ADMINISTRATION 
Systems  Research  l Development  Service 

Washington,  D.C.  20590  P'l 


NOT  I CE 


This  document  of  disseminated  under  the  sponsorship  of  the 
Department  of  Transportation  in  the  interest  of  information 
exchange.  The  United  States  Covernment  assumes  no  liability 
for  its  contents  or  use  thereof. 


! 


• i 


1 A*  e i . .■<  » N . 

. — . . r 

EAA-RD-/H-1  i 1 

/ 

i (lOVi'MlM  III  A » * C ktl  »>•»  No 


T * »!•  an  J SwS»  *-'• 


Operat  Iona  1 Evaluation  ot  an  Optical  Infrared 
Airborne  Proximity  Warning  Indicator  (Al’Wll 


Ag’ta*  % 

ERNEST  LUCIER 

^•'loumaj  O'^on  ta'ion  Nam«  and  Aildtau 

U • S*  Department  ot  Transpot  tat  ion 
Federal  Aviation  Administration 
Systems  Research  and  Development  Service 
Washington,  D.C.  20590 


Spnntonng  Agency  on<4  *Hdr**» 

U«  S,  Department  nt  Transportation 
Federal  Aviation  Administration 
Systems  Research  and  Development  Service 
Washington,  D.C.  20590 


$upol»m#r*»o» V No»«t 


Technical  Report  Documentation  Page 

1 K'ek  ipitnl  t Catalog  No 


5 

lU%v  ember  W7S 

t>  f*  «•»•**•  m i n»j  0 iion  joh.-t  v i*>if 

4RD-252 

r»  I'r  laimmi  O'gtitti  iitlii)’*  Krp»"l  Ne 


10  WoA  Umt  N.»  RA»S> 

11  Contract  ot  Gian*  No 

13  Type  of  Rapotf  and  Pound  C»'»  ♦ ••d 

FINAL 

December  1078 


14  Si'omoi.ng  Agsncy  Codo 


i M Ab»»roC 

I X.,.. 


This  report  summarises  the  results  of  an  operational  evaluation  conducted  bet wet’ii 
April  197b  and  August  1977  by  general  aviation  pilots  on  an  Airborne  Proximity 
Warning  Indicator  (APWI'.  The  APWI  evaluated  was  a Rock  Avionic  Systems  unit 
which  was  produced  by  the  Scientific  Prototype  Manul acturing  Company.  The 
KAA  conducted  an  operational  evaluation  ot  the  Rock  Avionic  APWI  using  loui 
systems  installed  in  general  aviation  aircraft.  The  evaluation  produced 

results  consisting  of  questionnaires  completed  hy  the  general  aviation  pilots 
who  f'ew  the  system. 

\ 


D,  key  Words  ' IS.  Di»*nbution  S»o»om»nt 

Infrared  Sensing, Proximity  Warning  Document  is  available  to  the  ll.S. 

Instrument, Airborne  Collision  Avoidanc » public  through  the  National  Technical 

Information  Service, 

Springfield,  Virginia  221  M 


I 1*.  S.cot  iy  CU.til.  (ot  ihi • topoti' 

I 

UNCLASSIFIED 

Form  DOT  F 1700.7  <»-7J' 


20.  Security  Clo*'»f.  (of  th»»  pnjel 

UNCLASS l FIFO 

Reproduction  of  completed  page  authorised 


21.  No.  of  Pog*i  22.  Pme 

14 


METRIC  CONVERSION  FACTORS 


1 


llctl 


« » 


iu 


rv't 


n 


in 

Hi!!  Hi! 


i i . ti! 


A 


ill  hiiii  $> 


J 


1 * 


ill 


I 


i 

► 

l 


- * 

^ g 

* *i  ^ m ] 

m 

5 -i  -.  S 

11 

« 

m 

s . * « ~ S 

• • « - • ■ 

• • K| 

. , i 

2 

» 

I 

Hill 

jjii 

Hi! 

ill 

m 

\ ii 

liiMf 

h 

: i 


I 8 . . I 1 


I ■Vk 


- I -r8u 


U 

u 


fs 


U 


u 


IS1*!1 

I I 


I 


S8.1  .f.  Ill 


i 


Hi!  illi!  Hi  lllifiii!  H 


i 


I 


I 


s 


1 

I 

1 


1 


^ - a 

25232  i 

E - £ 

I 

^ « N O ■ 

2 

> 

#?**##  * * B 

3 

I 

lit! 

hi! 

iiili 

ii{‘ 

llmid! 

• ill 

• « 

t!5 

ll 


I* 


n 


V' 

• t 

i* 

j; 


- 5 


!i 

i! 


'! 


1.0  Introduction 

1.1  Background 

1.2  Project  Objectives 

1.3  System  Description 

1.4  Laboratory  Test 

2. 9 Operational  Flight  Test  Results 

2.1  Data  Acquisition  Program 

2.2  Results  of  Post  Flight  Questionnaire 

2.3  Results  of  Post  Experiment  Questionnaire 
3.0  Suimtary  and  Conclusions 

Appendix  A Laboratory  Test  of  Rock  Avionics  APWI 
Appendix  B APWI  Post  Flight  Questionnaire 
Appendix  C APWI  Post  Experiment  Questionnaire 


r 


1.0  INTRODUCTION 


The  purpose  of  the  report  is  to  summarize  the  results  of  an 
operational  evaluation  conducted  between  April  1976  and  August  1977 
by  general  aviation  pilots  an  an  Airborne  Proximity  Warning  Indicator 
(APWI).  The  APWI  evaluated  was  a Rock  Avionic  Systems  unit  which  was 
produced  by  the  Scientific  Prototype  Manufacturing  Company.  The  Rock 
Avionic's  APWI  was  commercially  available  at  the  time  of  the 
evaluation. 


1.1  Background 

The  development  of  APWI  systems  has  been  In  response  to  the  problem 
of  midair  colllslons^and  near  midair  collisions  within  various 
segments  of  the  airspace.  In  the  search  for  systems  that  could 
effectively  eliminate  or  significantly  reduce  this  threat,  many 
systems  were  examined  Including  both  ground  and  airborne  based 
solutions.  These  solutions  Included  various  electronic  devices  that 
ranged  from  detection  and  alert  capabilities  only  (i.e.,  primarily 
warning  Indicators)  through  alert  and  locate  capabilities,  to  the 
Inclusion  of  maneuver  commands  to  avoid  a potential  collision  (I.e., 
Collision  Avoidance  Systems).  Among  this  group  of  candidate 
solutions,  a number  filtered  through  as  being  worthy  of  further 
exploration.  Proximity  Warning  Indicators  (PWI's)  were  selected  as 
one  of  those  solutions. 


In  general,  PWI  systems  can  be  either  ground-based  or  airborne-based 
and  are  designed  to  alert  pilots  to  the  presence  of  other  aircraft  In 
the  Immediate  area.  Depending  on  the  type  of  sensor  and  associated 
equipment,  the  pilot  can  be  provided  a simple  proximity  warning  in 
the  form  of  an  alert  only,  or  more  complete  Information  such  as 
bearing,  altitude  and  heading  to  aid  the  pilot  In  locating  the 
proximate  aircraft.  Some  PWI  systems  go  further  by  filtering  the 
sensor  Information  so  that  the  position  Information  Is  provided  only 
on  aircraft  that  are  potential  collision  threats  rather  than  just  In 
proximity.  PWI's  do  not,  however,  provide  maneuver  Information. 
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Th^  Rock  Avionic  system  is  a completely  airborne  system  using 
infrared  ( IR)  technology  to  provide  a proximity  alert  with  the 
approximate  bearing  of  the  threat  aircraft  given  in  60°  sectors. 

The  requirement  for  the  evaluation  of  this  APWI  was  generated  by  the 
National  Transportation  Safety  Board  ( NTSB } in  a letter  to  the  FAA  on 
October  16,  1974,  recommending  that  the  FAA  "should  conduct 
sufficient  tests  to  determine  the  effectiveness  of  the  supposedly 
Improved  system  (Rock  Avionic  Systems)."  The  FAA's  response  to  NTSB 
on  November  22,  1974,  indicated  that  "we  (FAA)  will  now  consider  what 
additional  test  activity  could  validate  the  benefits  of  an  IR  PWI  In 
the  traffic  patterns  of  uncontrolled  airports." 

In  response  to  the  NTSB  recommendation,  the  FAA  conducted  an 
operational  evaluation  of  the  Rock  Avionic  APWI  using  four  systems 
Installed  in  general  aviation  aircraft.  The  evaluation  period  for 
each  system  lasted  one  year  and  produced  results  consisting  of 
questionnaires  completed  by  the  general  aviation  pilots  who  flew  the 
system. 


1.2  Project  Objectives 

The  principal  objective  of  this  project  was  to  acquire  operational 
data  on  the  Rock  APWI  In  a general  aviation  environment  which  would 
permit  the  user  community  to  determine  the  usefulness  and  utility  of 
the  device  for  various  traffic  densities.  In  both  con^lled  and 
uncontrolled  airports.  An  equally  important  objective  Is  to  obtain 
an  indication  of  user  acceptance  of  this  type  of  device. 

The  data  collection  effort  Included  questions  to  qualitatively 
determine  technical  factors  including  range,  accuracy,  false  alarm 
rate,  missed  alarm  rate,  alarm  volume  and  detection  characteristic. 
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1.3  System  Description* 

The  Rock  Avionic  APWI  system  uses  electro-optics  to  passively  sense 
the  near-infrared  energy  emmitted  by  aircraft  strobe  anti-collision 
lights.  The  strobe  anti -collision  light  is  of  the  type  generally 
available  and  currently  used  on  air  carrier,  military  and  some 
general  aviation  aircraft.  The  system  consists  of  two  solid  state 
wing-tip  sensors  an  optional  tail  sensor,  a signal  processor  and  a 
panel  indicator.  The  elements  of  the  system  and  their  typical 
positioning  in  a general  aviation  aircraft  are  depicted  in  figure  1. 

The  operation  of  the  signal  processor  is  completely  automatic  and, 
therefore,  can  be  located  in  an  area  remote  from  the  cockpit.  It  is 
connected  by  cable  to  the  other  system  elements,  it  receives  input 
data  from  the  wing  tip  (and,  if  installed,  the  optional  tail  sensors) 
and  delivers  appropriate  control  signals  to  the  cockpit,  flashing  the 
sector  lights  on  the  panel  indicator  and  activating  a beeping  alert 
tone. 

The  panel  indicator  is  mounted  in  the  cockpit  control  panel.  It 
permits  the  pilot  to  monitor  the  display  while  also  attending  to 
other  cockpit  duties.  Its  circular  dial  is  divided  into  six  60° 
sectors  that  coincide  with  the  clock  positions  generally  used  to 
indicate  direction  of  visual  sightings.  The  two  sectors  to  the  right 
of  12  o'clock  are  defined  as  the  1 o'clock  and  3 o'clock  sectors, 
respectively;  the  two  sectors  to  the  left  of  12  o'clock  are  defined 
as  the  9 o'clock  and  11  o'clock  sectors,  respectively.  (The  5 
o'clock  and  7 o'clock  sectors  are  reserved  for  the  optional  tail 
sensor  that,  when  Installed,  will  provide  a system  that  completely 
encircles  the  aircraft).  Each  sector  occupied  by  an  Intruder 
aircraft  will  flash. 


•Reference  "Operator's  Instruction  Manual,  Aircraft  Proximity  Warning 
Indicator,"  Rock  Avionic  Systems,  Inc. 
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As  shown  In  figure  2,  the  panel  Indicator  contains  a single  operating 
control,  a toggle  switch  with  three  positions:  an  off  (down) 
position,  a self  check/high  sensitivity  (center)  position  and  a low 
sensitivity  (up)  position.  The  automatic  self  check  feature  Is 
energized  whenever  the  operating  control  Is  moved  to  the  center,  or 
high  sensitivity,  position.  If  the  system  Is  functioning  properly 
all  sectors  will  flash  simultaneously  si*  times  and  then 
automatically  go  Into  Its  high  sensitivity  mode  of  operation.  An 
additional  feature  of  the  display  Is  a photo  sensor  that 
automatically  dims  the  Intensity  of  the  sector  flashing  as  cockpit 
lighting  conditions  vary  from  day  to  night.  In  the  low  sensitivity 
position,  system  sensitivity  Is  reduced  and  only  strobe  light 
infrared  emissions  up  to  approximately  1/2  mile  distant  will  be 
processed.  The  low  sensitivity  indicator  at  the  center  of  the 
display  will  glow  red  for  as  long  as  the  switch  remains  in  this 
position. 

In  the  center  of  the  indicator  Is  a white  two-inch  circular  dial 
which  includes  the  six  60°  sectors  previously  discussed.  These 
comprise  the  four  forward  warning  sectors  and  the  two  optional 
rearward  warning  sectors.  When  one  or  more  of  these  sectors  light 
and  flash  in  synchronism  with  the  beeper  tone  In  the  cockpit  speaker, 
the  presence  of  intruding  aircraft  flying  parallel  to,  or  across  the 
flight  path.  Is  Indicated.  The  aircraft  may  be  visually  acquired  by 
looking  In  the  direction  Indicated  by  the  flashing  sector. 

The  wing-tip  (and  optional  tail)  sensors  are  electro-optical  and 
Installed  within  the  contours  of  each  of  the  aircraft's  wing  tips. 
These  sensors  detect  the  infrared  energy  emitted  by  the  high 
Intensity  strobe  lights  of  other  aircraft  and  respond  with 
corresponding  electrical  output  signals.  These  signals  are  applied, 
via  an  Interconnecting  cable,  to  the  signal  processor  for  analysis. 
Each  sensor  provides  a 120  degree  segment  of  horizontal  coverage, 
with  respect  to  the  aircraft's  nose,  and  an  elevation  (vertical) 
resolution  of  plus  or  minus  10°  as  Illustrated  In  figure  3. 

A summary  of  the  pertinent  technical  data  of  the  system  Is  presented 
In  table  1 
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HORIZONTAL  SCAN 


t 

VERTICAL  SCAN 

o 

Range  adjusts  from  1-1/2  miles  for  cruising  to  1/2  mile  for 


At  1-1/2  miles,  the  Rock  Avionic  APWI  covers  quarlcr-milc-high 
sectors  above  and  below  your  airplane  extending  120°  on  cither  side 
of  the  nose,  or  in  a complete  circle  with  an  optional  tail  sensor. 
Nearby  aircraft  that  will  pass  safely  above  or  below  your  flight  path 
are  ignored. 


APWI  Horizontal  and  Vertical  Coverage 


Figure  3: 


TECHNICAL  DATA 


Area  Coverage 

Horizontal* 

Resolution 

Elevation 

Detection  Range 


240° 

600 


1/2  to  1-1/2  miles 
(maximum) 


Outputs 


Visual 


Audio 


Display  Area 


Controls 


Power  Reguired 


Weight 


Dimensions 


Panel  Indicator 
Sensors 

Signal  Processor 


Segmented  60°  sectors 

0.1  watts  (nom.)  into 
4,8,  or  16  ohms 

2 inches 

Single  3-position 
toggle  switch 

12-14  vdc  at  1.5  amps 
24  vdc  at  2.0  amps. 

6 . 5 pounds 


2-9/16"  x 2-9/16"  x 1-5/8" 
2-7/8"  x 4-3/4"  x 2-13/16" 
6-3/4"  x 7-11/16"  X 4-15/16" 


*360  horizontal  coverage  with  optional  tail  sensor. 


TABLE  1 
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1.4  laboratory  Tests 


laboratory  tests  were  conducted  by  tbe  Transportation  System  Center 
(TSC)  on  tbe  Rock  System.  These  tests  invest t gated  the  beam  pattern, 
noise  susceptibility,  multiple  target  capability  and  sensitivity.  An 
earlier  version  of  this  system  had  demonstrated  negative 
characteristics  in  these  areas.  These  tests  were  to  Isolate  any 
inherent  characteristics  in  the  equipment  that  would  show  up  under 
operational  testing.  These  tests  showed  that  the  Rock  System  had 
relatively  good  range  uniformity  over  the  field  of  view  and  that 
spurious  alarms  would  not  Interfere  with  an  operational  flight  test 
of  this  equipment.  The  results  of  the  TSC  laboratory  tests  are 
Included  In  Appendix  A for  completeness. 

2.0  OPERATIONAL  RIGHT  TEST  RESULTS 

2. 1 Data  Acquislt i on  Program 

The  objective  of  this  evaluation  program  was  to  determine  the 
usefulness,  utility  and  user  acceptance  of  the  Rock  APWl  system  for 
various  traffic  densities  in  both  controlled  and  uncontrolled 
environments.  The  objective  of  the  data  acquisition  flight  program 
was  to  acquire  operational  data  representative  of  conditions  at  and 
about  typical  general  aviation  airports,  both  controlled  and 
uncontrolled. 

This  program  was  a minimal  cost  effort  to  obtain  user  response  to  the 
Rock  Avionic  Systems,  APWI  an  optical-infrared  aircraft  strobe  light 
detection  device  used  as  a proximity  warning  system.  The  program 
consisted  of  five  separate  small  contracts,  one  with  the  manufacturer 
and  four  with  the  aircraft  owners.  The  data  acquisition  effort 
consisted  of  questionnaires  to  be  completed  by  tbe  participating 
pilots  after  having  used  the  system.  These  questionnaires  (See 
Appendix  B,  Post  Flight  Questionnaires)  were  distributed  at  the 
beginning  of  the  contract  along  with  franked  envelopes  addressed  to 
the  responsible  FAA  project  office.  The  pilots  were  to  mail 
completed  questionnaires  after  flying  with  the  system.  The 
Information  collected  from  these  questionnaires  is  contained  in 

Srs  t UUt  2.  . 
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The  aircraft  In  which  the  equipments  were  Installed  are 

a)  a Cessna  172  owned  by  a private  pilot  and  based  at 
Freeway  Airport,  Maryland, 

b)  a Cessna  172  owned  by  a fixed  base  operator  (FBO)  based 
at  I si  Ip,  New  York 

c)  a Cessna  182  owned  by  an  FBO  at  Gaithersburg,  Maryland 

d)  a Piper  180  privately  owned  by  five  pilots  and  based 
at  Hagerstown,  Maryland. 


The  pilots  participating  In  this  program  Included  general  aviation 
and  Instructor  pilots  with  private,  commercial  or  airline  transport 
certificates.  About  half  of  the  pilots  had  their  Instrument  rating 
and  most  flew  over  200  hours  per  year.  The  majority  of  the 
operational  flights  were  conducted  under  VFR  conditions  with  about 
half  of  the  flights  operating  from  controlled  airports.  The  Rock 
APWI  system  was  assembled,  tested  and  Installed  by  the  manufacturer. 
Scientific  Prototype  Mfg.  Corp.  of  New  York,  New  York.  The 
manufacturer  was  contracted  to  Install,  maintain,  repair,  and  remove 
the  APWI  Systems  during  the  period  encompassing  the  four  contracts 
with  the  aircraft  owners.  The  owners  were  contracted  and  briefed  to 
use  the  equipment  In  a normal  manner,  evaluate  the  system  and  report 
their  findings  by  filling  out  questionnaires  provided  by  the  FAA 
during  the  period  of  the  contracts. 

The  manufacturer  arranged  for  Installation  at  Wiggins  Airways  Inc.  of 
Norwood,  Massachusetts  and  performed  acceptance  tests  on  the  two 
Cessna  172 's,  the  Cessna  182  and  the  Piper  180.  All  three  Cessnas 
are  hlghwlng  aircraft  with  the  Piper  180  being  a low  wing  aircraft. 

In  the  beginning,  three  of  the  units  worked  satisfactorily  with 
minimum  maintenance.  The  fourth  unit  failed  during  the  flight  to  '>e 
operating  base  of  the  owner  and  during  the  program  continued  to 
require  excessive  maintenance. 


This  was  primarily  due  to  the  "own  strobe"  lockout  feature.  This 
particular  aircraft  has  non- synchronous  wing  tip  strobes  and  this 
configuration  Imposes  severe  limits  on  the  system.  The  strobe  lights 
could  have  been  synchronized  but  this  was  deemed  not  advisable,  since 
many  aircraft  have  non-synchronous  strobes. 

The  aircraft  at  Freeway  airport  was  moved  to  Gaithersburg,  Maryland 
during  the  course  of  the  program.  Check  flights  were  made  during 
this  period  with  FAA  personnel  and  the  equipment  appeared  to  be 
operating  correctly.  However,  at  the  end  of  the  contract  period  the 
equipment  could  not  be  made  to  work  for  a demonstration  ride. 

The  aircraft  at  Isllp  resulted  In  the  most  pilot  responses  of  the 
questionnaire  because  of  the  lease  operation.  However,  during  the 
course  of  this  contract  the  aircraft  was  sold.  Fortunately,  the 
aircraft  was  leased  back  to  the  FBO  and  the  test  continued 
uninterrupted. 

The  FBO  owned  aircraft  at  Gaithersburg  was  sold  to  a private  pilot 
early  in  the  test  period.  The  new  owner  assumed  the  obligations  of 
the  contract.  However,  this  meant  only  one  pilot  would  be  flying 
this  aircraft  instead  of  numerous  pilots  in  the  leased  operation. 

Due  to  the  particular  strobe  light  configuration  on  this  aircraft 
considerable  difficulty  was  experienced  in  obtaining  satisfactory 
operation.  The  designer  made  several  trips  to  Gaithersburg  to 
maintain  this  unit.  A ground  check  of  the  system  was  made  three 
months  after  Installation  and  the  strobe  lockout  feature  was 
inoperative.  Investigation  showed  one  of  the  lockout  sensors  was  not 
working  and  a "light  tube"  on  the  second  lockout  unit  was  missing. 

The  aircraft  was  flown  to  New  York  to  permit  the  maintenance 
contractor  to  use  shop  test  equipment  to  correct  this  lock  out 
circuitry  and  replace  the  missing  "light  tube."  The  equipment  was 
not  repaired  on  that  trip  and  necessitated  a trip  by  the  manufacturer 
to  Gaithersburg.  The  equipment  failed  again  and  was,  subsequently, 
removed  per  request  of  the  owner. 

The  system  on  the  aircraft  at  Hagerstown,  Maryland  worked 
satisfactorily  during  the  course  of  the  contract. 


2 . 2 Results  of  Post  Flight  Questionnaire 


The  number  of  questionaires  completed  and  their  relationship  to 
aircraft,  number  of  pilots,  and  airports  where  they  were  based  are 
presented  in  Table  2.  Questionnaires  supplied  by  the  FAA  were 
received  from  pilots  of  each  of  the  aircraft  indicating  that  user 
acceptance  of  the  system  is  good  when  the  system  works  properly.  The 
subjective  impressions  of  the  pilots  and  their  operational 
experiences  were  obtained  from  the  completed  questionnaires  and  are 
sunmarlzed  in  the  following  paragraphs: 

1.  A number  of  pilots  expressed  dissatisfaction  with  this 
particular  piece  of  equipment  because  of  its  false  alarms 
and  unreliable  operation.  Some  turned  off  the  APWI  because 
of  the  high  frequency  of  alarms.  These  pilots  all  operated 
from  a Long  Island,  New  York  airport  and  they  felt  that 
reflections  off  the  water  were  a particular  problem.  One 
pilot  didn't  turn  the  system  on  because  the  aural  warnings 
were  reported  to  be  excessive  by  other  pilots. 

2.  A number  of  equipments  experienced  operational  difficulty 
and  required  excessive  service.  One  pilot  requested  the 
equipment  be  removed  from  his  airplane  because  it  did  not 
work.  Others  expressed  a desire  for  increased  reliability 
in  this  equipment. 


3.  One  pilot  did  discover  an  application  that  was  not  part  of 
the  design.  During  a final  approach.  In  IFR  conditions, 
the  APWI  warning  was  activated  by  the  flashing  strobes  at 
the  airport  before  the  pilot  could  see  them.  The  lighted 
sector  correctly  indicated  the  pilot  was  left  of  the  final 
approach  course. 

These  results  did  not  appear  to  reflect  all  of  the  information 
available  from  this  program.  The  design  of  this  questionnaire  and 
the  lack  of  more  substantive  comments  on  the  completed  questionnaires 
did  nuc  permit  meeting  the  program  objectives.  To  gather  more 
Information  a second  questionnaire,  a Post  Experiment  Questionnaire 
(Appendix  C)  was  created.  | 


The  questionnaire  was  hand  carried  to  all  of  the  available  pilots 
that  had  participated  in  the  program.  The  data  collected  from  the 
Post  Experiment  Questionnaire  is  contained  in  Section  2.3. 


! 


2.3  Results  of  the  Post-Experiment  Questionnaire 

Table  2 in  Section  2.2  contains  information  on  the  numbers  of 
questionaires  completed  and  their  relationship  to  the  aircraft  and 
airports  where  they  were  based.  The  subjective  impressions  of  the 
pilots  and  their  operational  experiences  as  obtained  from  the 
completed  Post -Experiment  Questionnaires  are  summarized  in  the 
following  paragraphs: 

1.  One  pilot  said  the  APWI  was  too  sensitive  because  the 
warnings  occured  in  the  airport  pattern.  His  APWI  was 
alarming  from  the  strobe  lights  of  aircraft  on  the  ground. 
As  a consequence  he  turned  the  APWI  off  in  the  pattern. 

2.  As  a group,  the  pilots  found  the  APWI  to  be  more  useful  at 
visibilities  less  than  10  miles  (i.e.,  relatively  good  VFR 
condition.) 

3.  One  pilot  shut  the  APWI  off  because  "the  alarm  went  off  all 
of  the  time." 

4.  Alerts  occurred  for  which  the  pilots  did  not  observe  any 
aircraft. 

5.  The  system  interfered  with  flying  because  of  the  false 
alarms  and  the  difficulty  in  interpreting  the  slowly 
flashing  display-  The  difficulty  in  Interpreting  the 
flashing  display  occured  when  a pilot  made  a quick  glance 
at  the  flashing  display  and  found  the  display  in  the  off 
part  of  its  alarm  cycle  (1  second  on  and  1 second  off)  with 
the  sector  not  visable  to  the  pilot. 
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When  the  beeping  tone  is  sounded,  it  would  draw  the  pilot's 
attention  to  the  display;  however,  by  the  time  the  pilot 
turned  his  attention  to  the  display  the  light  had  gone 
off.  The  pilot  made  the  suggestion  of  alternating  the 
sound  and  light  alarms. 

6.  One  pilot  expressed  the  opinion  that  a pilot  should  have 
all  the  help  possible,  especially  in  the  proximity  of 
larger  airports. 

7.  Operation  was  better  on  top  of  overcast. 

8.  Most  pilots  thought  the  APWI  would  be  most  useful  in  cruise 
flight. 

9.  Some  pilots  expressed  the  opinion  that  decreasing  the 
vertical  look  angle  (currently  + 10°  from  the  horizontal 
plane)  would  decrease  false  alarms  in  the  pattern  from 
aircraft  on  the  ground. 

10.  None  of  the  pilots  reported  any  changes  in  their  flying 
procedures  as  a result  of  the  APWI. 

11.  Most  pilots  agreed  with  the  indicated  APWI  sixty  degree 
sector  when  a visually  acquired  aircraft  was  identified 
with  the  alarm. 

12.  Most  of  the  pilots  that  used  the  APWI  turned  the  equipment 
on  for  more  than  75  percent  of  their  flying. 

13.  The  APWI  did  alert  the  pilots  to  other  aircraft  of  which 
they  were  not  aware.  Two  pilots  felt  that  the  equipment 
had  prevented  them  from  having  a midair  collision. 

14.  All  of  the  pilots  believe  that  they  have  less  than  five 
near  misses  per  year. 


i 


15.  About  half  of  the  pilots  would  like  to  have  this  equipment 
In  all  aircraft  they  fly.  The  pilots  who  did  not  want  the 
equipment  expressed  dissatisfaction  with  the  reliability 
and  the  false  alarms. 

16.  The  pilots  suggested  that  a complete  PWI  service  should 
provide  the  following  Information  on  proximate  aircraft: 

. Range 

. Altitude 

. Course  (Heading) 

. Bearing 

Range  rate  (l.e.,  rate  of  closing)  and  velocity  were  also 
Indicated  but  not  as  strongly. 

17.  Less  than  half  of  the  pilots  had  maneuvered  on  the  basis  of 
a warning  and  when  they  did  a horizontal  maneuver  was 
preferred. 

18.  Most  cf  he  pilots  felt  they  needed  a warning  at  greater 

than  t seconds  and  a range  greater  than  one  mile  to  avoid 

another  aircraft. 

i 

19.  Recommendations  for  Improving  the  system  Included: 

. decrease  the  vertical  coverage 
. decrease  false  alarms 
. Increase  reliability 

Only  one  pilot  had  flown  another  APWI  system;  but,  no 
comparative  comnents  were  made. 
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3.0  Summary  and  Conclusion 


The  operational  flight  tests  produced  significant  qualitative  results 
in  the  form  of  the  subjective  judgements  of  general  aviation  pilots. 
The  majority  of  the  operational  data  collected  can  be  summarized  as 
follows: 

1.  The  Rock  Avionics  PWI  did  serve  to  alert  the  pilots  to  the 
presence  of  aircraft  of  which  they  were  not  aware;  however, 

a)  the  high  alarm  rate  detracted  from  the  utility  of  the 
Rock  System  around  airports  with  a high  level  of  activity, 
and 

b)  the  false  alarm  rate  was  found  objectionable  by  a 
significant  number  of  pilots  in  both  high  and  low  density 
airspace. 

2.  After  considering  the  limitation  associated  with  and 
benefits  to  be  derived  from  the  Rock  Avionic  APWI, 
approximately  one  half  of  the  pilots  responding  to  the 
questionnaire  Indicated  that  they  would  like  to  have  the 
equipment  in  all  aircraft  they  fly.  The  pilots  responding 
also  Indicated  that  the  utility  of  the  Rock  Avionic  system 
would  be  significantly  Increased  by  increasing  the 
equipment  reliability  and  decreasing  the  false  alarm  rate. 


APPENDIX  A 


LABORATORY  TEST  OF  ROCK 

AVIONICS  APWI 


(Section  3 From  Airborne  Proxmity 
Warning  Instrument  Laboratory 
Test,  Report  No.  FAA-RD-77-5 
January  1977.) 


3.  PERFORMANCE  OF  TEST 


Tests  were  conducted  on  the  Rock  System  in  four  areas:  Beam 
Pattern;  Noise  Susceptibility;  Multiple  Target  Capability;  and 
Sensitivity.  The  test  setup  is  shown  in  Figure  1;  the  results  are 
shown  in  Figure  2. 


The  Rock  Avionics  designers  accomplished  this  breakthrough  by 
the  application  to  a commercial  product  of  a principle  described 
in  the  literature  as  "channel-optics"  and  hitherto  used  only  in 
specialized  laboratory  devices.  The  advantage  of  this  approach 
is  that  while  it  provides  the  signal  enhancing  properties  of  large 
aperture,  it  is  non- imaging  and  thus  is  capable  of  sensing  signals 
while  exposed  to  direct  sun-light. 

Physically,  the  sensor  consists  of  a plastic  precision  cast 
cylinder  lens,  which  operates  in  the  refractive  mode  in  elevation 
and  in  the  reflective  mode  in  azimuth,  by  virtue  of  an  external 
coating  on  the  four  sides.  The  back  portion  of  the  solid  lens 
contains  the  silicon  diode,  which  forms  the  active  part  of  the 
sensor.  The  sensor  assembly  also  contains  the  preamplifier,  which 
determines  the  system's  bandwidth  and  provides  the  signals  to  the 
logic,  noise  control  and  threshold  circuits. 

The  signal  processing  unit  contains  a novel  application  of 
computer  technology  to  the  task  of  signal  discrimination.  It  is 
not  described  here  because  of  its  proprietary  nature,  but  was 
tested  for  proper  functioning. 

3.1  PATTERN 

The  most  extensive  test  performed  concerned  the  sensor  pattern 
of  the  system.  An  optical  bench  was  set  up,  as  shown  in  Figure  1. 
The  light  from  an  anticollision  strobe  was  collimated  so  that  a 
3 inch  diameter  beam  was  formed.  A sensor  head  was  mounted  on  a 
double  rotary  head,  permitting  its  orientation  with  respect  to  the 
beam  through  arcs  of  t6S#  and  t6°.  The  test  flash  was  directed 
through  the  center  of  a reflective  screen,  which  was  illuminated 
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Figure  2. 


RANGE  Variation  vs  Azimuth  (Normalized) 


alternately  with  a 100  watt  desk  lamp,  and  a S00  watt  projection 
lamp,  providing  illumination  levels  comparable  to  light  dusk  and 
overcast  daylight,  respectively.  The  pattern  measurement s were 
all  performed  at  the  lower  background  illumination  level.  The 
intensity  of  the  collimated  beam  flash  was  adjusted  by  field  stops 
and  neutral  density  filters  so  that  during  an  exploratory  sweep 
of  the  sensor  head  through  its  FOV,  the  signal  did  not  saturate 
in  the  most  sensitive  positions  and  was  strong  enough  to  produce 
an  aural  alarm  and  bearing  indication  2°  beyond  the  corners  of 
the  FOV.  At  that  intensity,  five  horizontal  and  two  vertical 
sweeps  were  taken  through  the  FOV  of  one  sensor. 

The  results  are  shown  in  Table  1.  The  measurements  were  taken 
as  analog  peak  signal  voltages,  read  on  an  oscilloscope,  with  a 
monitor  on  the  threshold  DC  voltage,  which  remained  constant. 

Each  datum  point  recorded  represents  the  average  value  of  ten  ob- 
servations. The  other  sensor  head  was  spot  checked  at  one  upper 
and  one  lower  corner  and  at  the  center  of  the  field  of  each  sensor. 
The  data  obtained  being  virtually  identical  with  those  of  the  first 
head,  the  pattern  measurement  was  considered  completed. 

As  the  graph  shows,  the  least  sensitive  point  of  the  sensor 
pattern  lies  at  -10°  elevation  at  the  junction  of  the  two  lobes. 

The  present  graphs  are  normalized  to  this  point,  a procedure  that 
may  be  regarded  as  overly  conservative.  In  practice,  it  would 
be  advantageous  to  the  owner  of  such  a device  to  optimize  the  cov- 
erage vs.  range  performance  by  physical  adjustment  of  the  two  op- 
tical elements  with  respect  to  each  other.  Even  without  such 
adjustment,  the  range  uniformity  obtained  was  excellent. 

3.2  FREEDOM  FROM  SPURIOUS  ALARMS 

A high  noise  level  near  the  threshold  detector  will  result  in 
a high  number  of  spurious  alarms.  A rigorous  laboratory  test  to 
determine  the  frequency  of  false  alarms  requires  a far  more  ela- 
borate effort  than  available  resources  allowed.  However,  the  test 
did  provide  a sufficient  level  of  background  illumination  to  pro- 
vide reasonable  assurance  that  under  normal  sky- illumination  (1000 
ft.  lamberts)  the  spurious  alarm  rate  should  be  low.  During  the 
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tost,  false  alarms  did  not  occur.  The  peak  noise  level,  whenever 
observed,  never  exceeded  35  SO  millivolt  (at  a threshold  level  of 
one  volt).  We  must  note,  however,  that  background  illumination  is 
not  the  only  source  of  noise.  It  can  he  stated  that,  on  the  basis 
of  the  remarkably  noise  free  behavior  under  normal  test  conditions, 
and  the  corroborating  statements  of  the  manufacturer  about  the 
behavior  of  the  instrument  in  a flight  environment,  that  the  chances 
for  a successful  flight  test  are  not  likely  to  be  diminished  by  a 
high  incidence  of  false  alarms. 

3.3  MULTIPLE  TARGET  CAPABILITY 

While  the  unit  was  exposed  to  a series  of  flashes  from  an  angle 
of  about  10°,  a second,  non  - synchronous  flash  source  was  energized, 
from  an  angle  of  about  110°.  Both  sectors  indicated  targets  as 
required.  Movement  of  the  second  source  through  the  100°  arc  toward 
the  first  source  resulted  in  a double  aural  alarm,  again  as  spec- 
ified. This  test  demonstrated  the  required  multiple  target  capa- 
bility and  should  prove  quite  satisfactory  in  flight  tests,  as 
reported  by  the  manufacturer. 

3.4  ESTIMATE  OF  SENSITIVITY 

The  laboratory  test  of  the  Rock  Avionics  APW1  did  not  permit 
a precise  sensitivity  test  because  the  spectral  transmission  of 
the  Infra  red  filter  that  forms  part  of  the  unit's  optical  system 
is  unknown.  In  any  event,  the  range  of  the  device  is  a statisti- 
cal measure  depending  on  the  illumination  level  and  must  be  deter- 
mined in  a flight  environment  since  the  threshold  voltage  is  a 
function  of  the  total  electronic  noise  level.  The  general  per- 
formance of  the  device  in  the  laboratory  lends  significant  weight 
to  the  credibility  of  the  manufacturer,  who  represents  the  instru- 
ment as  attaining  an  operational  range  of  1.5  miles. 
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APw’l  POST  r'LI  J'T  Cl^STnN’.'rtlK" 

1.  Pilot  Certificate;  "tuJont.  Private  Comm ore ; •» l 

Airline  Transport  '-’llitnrv  '’Lie*. 

2.  Instrument  Katinv?  (check,  if  yes) 

3.  Type  of  cli',ht  nlan:  WR 

4.  Flight  Route  and  Altitule  

5.  Flight  Duration  

6.  General  Weather  Description  


•f 

1 • 

Number  of 

APWI  Warnings: 

Lo  Range; 

None; 

Few-Oty 

• 

Mqnv-Otv 

• 

Mi  Range; 

None; 

Few-htv 

• 

Manv-Otv 

• 

. ..  • 

b. 

Humber  of 

These  Aircraft 

Actually  Seen: 

Lo  Ranee: 

None; 

Few-Qty_ 

• 

Vanv-Otv 

• 

Hi  Range: 

None; 

Few-0ty_ 

• 

Manv-"!t.v 

• 

9. 

Were  There 

■ Occasions  VJnen 

Alarmed  for  Vo 

Apparent. 

Reason? 

Never 

Occasionally- 

Ctv  . : 

Freouent lv-^tv 

; 

10.  When  Alarmed  and  You  Visually  Detected,  Did  You  Generally  A-vee  with  the 
APWI  Sector: 

Yes;  Vo; 

11.  Number  of  Multiple  Aircraft  Detections  (more  than  one  sector  lighted) 

Lo  Range:  None;  Few-Otv ; ►’nnv-Ot.v ; 

Hi  Ranee:  Done;  pew-otv ; Manv-Ov.v ; 

12.  General  Operational  Comments  
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APWI  POST  EXPERIMENT  QUESTIONNAIRE 

1.  NAME 

2 . PLANE  TYPE 

3 • PILOT  CERTIFICATE: 

£7  STUDENT 
£7  PRIVATE 
U COMMERCIAL 
£7  AIRLINE  TRANSPORT 
£T  MILITARY  PILOT 

1*.  APPROXIMATELY  HOW  MANY  HOURS  DO  YOU  FLY  PER  YEAR? 
f ~7  Less  than  100 
[J  100  to  200 

£7  Greater  than  200 
5 . INSTRUMENT  RATING 


£7  Yes 

£7  No 

APWI  USED  WITH  FLIGHT  PLANS 
£7  VFR 

£7  IFR 

H Other 


tfSUAL  AREA  OF  OPERATION? 
£7  Uncontrolled  airport 
£7  Controlled  airport 
£7  Approach 
£7  En  route 
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8. 


DID  YOU  FIND  THE  APWI  TO  BE  MORE  USEFUL  IN  SPECIFIC  LEVELS 
OF  VISIBILITY? 

O No 
O YES 

n Greater  than  10  miles 
fj  Between  5 and  10  miles 
n Less  than  5 miles 

9.  LIGHT  CONDITIONS 
f~~J  Dawn 

O Day 

I~1  Dusk 

Z7  Night 

10.  WEATHER 

f~l  Overcast 
f~l  Haze 
I~1  Clear 

11.  ALARMS 
O No 
D Yes 

/ / Aircraft  seen  before  (always,  sometimes,  never) 

/ / Aircraft  seen  after  (always,  sometimes,  never) 

/ / Aircraft  not  seen  (always,  sometimes,  never) 

12.  WHEN  ALARMED  AND  AIRCRAFT  VISUALLY  ACQUIRED,  DID  YOU  USUALLY  AGREE 
WITH  THE  APWI  SECTOR? 

O Yes 

O No 


C-2 


I m 


13.  APPROXIMATELY  WHAT  PERCENT  OF  THE  TIME  DID  YOU  USE  THE  APWI  WHEN 
PILOTING  THE  AIRCRAFT? 


14. 


15. 


16. 


17. 


£7  100  Percent, 
a 90  - IOC  Percent 
£7  73  - 90  Percent 
o 30  - 73  Percent 

£7  Less  than  50  Percent 

APPROXIMATELY  HOW  MANY  TIMES  HAS  THE  APWI  ALERTED  YOU  TO  OTHER 


AIRCRAFT  OF  WHICH  YOU  WERE  NOT  AWARE? 

Do  O 

0 to  10* 

£7  1 

£7 

11  to  20* 

£7  2 or 

£7 

21  to  30* 

£7  3 

£7 

31  to  40* 

£7  k 

£7 

4l  to  50* 

!~~J  3 or  more 

£7 

greater  than  50* 

IN  YOUR  OPINION,  HAS  THE  APWI 

PREVENTED  YOU  FROM  HAVING 

COLLI SION » NUMBER  OF  TIMES 

£7o 

£7 

3 

£7  1 

£7 

4 

£72 

£7 

5 or  more 

WHAT  PERCENT  OF  THE  TIME  DID 

THE  APWI 

APPEAR  TO  WORK? 

£J  75  to  100* 

£7 

25  to  50* 

£7  50  to  75* 

£7 

0 to  25* 

DID  THE  APWI  INTERFERE  WITH  FLYING? 

£7  No 
£7  Yes 

How? 


t 


>! 


iJ 
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APPROXIMATELY  HOW  MANY  NEAR  MISSES  PER  YEAR  DO  YOU  HAVE? 

£7  C 

O 1*°  * 

rT  5 or  greater 

WOULD  YOU  LIKE  TO  HAVE  THIS  EQUIPMENT  IN  ALL  AIRCRAFT  YOU  FLY? 
£7  Yes 

rj  no 


WHAT  PHASE  OF  FLIGHT  DO  YOU  THINK  AN  APWI  WOULD  BE  MOST  USEFUL? 
£7  Tkxi 
£7  Takeoff 

£7  climb 

I~1  Cruise 

£7  Descent 

£7  Holding 

£7  Traffic  pattern 

£7  Approach 

!~J  Landing 

£7  Missed  approach 

WHAT  IS  THE  MINIMUM  AMOUNT  OF  INFORMATION  YOU  WOULD  WANT  ON  A 
THREAT  AIRCRAFT? 

I~T  Range 

l~J  Range  rate  (Rate  of  closing) 

77  Altitude 
H Vertical  Speed 
/ / Course  (Heading) 

£7  Velocity 


£7  Area  of  closest  approach 
7*7  Bearing 

77  'type  aircraft  (e.g.,  small, 
light  ffwitv  or  air  carrier) 

£7  Other 
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22.  DID  ANY  OF  THF  WARN! NT 


TO  PF  INCORRFCT? 


3.  HOW  MUCH  TIMF  DO  YOU  FEEL  YOU  NEED  TO  AVOID  ANOTHER  AIRCRAFT? 


Multi 


3 to  lt  seconds 


5 to  i)  seconds 


seconds 


20  to  2$  seconds 


DID  YOU  MANEHTFR  ON  THE  BASIS  OF  ANY  WARNINGS? 
n Verti  cal 


~7  Horizontal 


25.  AT  WHAT  RANGF  WOULD  YOU  LIKE  TO  BE  WARNED  OF  THE  PROXIMITY  OF 


ANOTHER  AIRCRAFT? 


/~7  Less  than  l/U  mile 
D lA  to  l/2  mile 
f^r  1/2  to  1 mile 
D 1 to  2 miles 
r~7  2 to  h miles 


Greater  than  U miles 


WHAT  RFCOMMENIWnONT'  WOlfT.!'  YOU  MAKF  FOR  IMPROVING  AN  APWT? 


HAVE  YOU  FLOWN  ANY  OTHER  AP'WI  PFVI OET<? 

O No 
£7  Yes 

WHAT  fCINT),  'WHEN  ANP  ANY  COMFARATt  VF  COMMENTT 
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